One-bit stochastic resonance storage device 



S. A. Ibanez 1 P. I. Fierens 1 G. A. Patterson 2 R. P. J. Perazzo 1 

D. F. Grosz 1 - 2 ' 3 

November 5, 2009 

Abstract 

The increasing capacity of modern computers, driven by Moore's Law, is accompanied by 
smaller noise margins and higher error rates. In this paper we propose a memory device, 
consisting of a ring of two identical overdamped bistable forward-coupled oscillators, which 
may serve as a building block in a larger scale solution to this problem. We show that such a 
system is capable of storing one bit and its performance improves with the addition of noise. 
The proposed device can be regarded as asynchronous, in the sense that stored information 
can be retrieved at any time and, after a certain synchronization time, the probability of 
erroneous retrieval does not depend on the interrogated oscillator. We characterize memory 
persistence time and show it to be maximized for the same noise range that both minimizes 
the probability of error and ensures synchronization. We also present experimental results for 
a hard-wired version of the proposed memory, consisting of a loop of two Schmitt triggers. We 
show that this device is capable of storing one bit and does so more efficiently in the presence 
of noise. 

1 Introduction 

The increasing capacity of modern computers has been driven by Moore's Law, which postulates 
that the maximum number of transistors in an integrated circuit doubles every two years. However, 
as noted in [I], noise inmunity and power consumption do not follow Moore's law. On the contrary, 
higher transistor density and power consumption require the use of smaller supply voltages. All 
these factors together lead to smaller noise margins and higher error rates in computation ([5]). 
There have been several proposals to solve this problem, e.g., [HUSH] take explicitly into account 
the fact that results may be correct only with some probability, and [5] uses a set of orthogonal 
noise processes to represent logic values. Recently [B], it was shown how to implement basic 
logical operations (OR, AND, NOR, NAND) using nonlinear systems such that their performance 
improves in presence of noise, a signature of stochastic resonance. 

Stochastic resonance (SR) is usually associated with a nonlinear system where the noise helps, 
an otherwise weak signal, to induce transitions between stable equilibrium states [7J E] ■ The 
phenomenon of stochastic resonance has been studied in a large number of applications, ranging 
from biological and neurological systems [THl EJ US] , information transmission sustained by noise 
[UmHSHElinillB], t0 information storage PH H3 HI] • In PUIU], a ring of identical oscillators 
was shown to be able to sustain a travelling wave with the aid of noise, long after the harmonic 
drive signal had been switched off. It is only natural to ask whether such a scheme can be used 
to store data, i.e., aperiodic signals, in noisy environments. In this work, we analyze the dynamic 
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behavior of the shortest ring possible, comprising only two forward-coupled bistable oscillators. We 
show that such a system is capable of storing a single bit of information via stochastic resonance. 

Memory performance is characterized in terms of the probability of an erroneous bit detection. 
In particular, we show that by the addition of a small amount of noise, the system outperforms 
the deterministic (noiseless) case. We also show that information can be retrieved from any of the 
two oscillators, obtaining the same probability of error after an elapsed 'synchronization' time that 
decreases with increasing noise. Moreover, there is a noise range that yields a minimum probability 
of error with a nearly minimum synchronization time. By comparing system performance to that 
of the noiseless case, we define a memory persistence time and show it to exhibit a stochastic- 
resonance behavior. 

Finally, we build a model of the proposed system with two Schmitt triggers (STs) in a loop 
configuration. STs provide a convenient 'discrete' model of the bistable oscillators [22]. By feeding 
each ST with Gaussian noise, we show that the system is capable of storing a single bit, and it 
does so more efficiently for an optimum amount of noise. 

The paper is organized as follows: Section [2] describes the system under analysis. In Section 
[3] we present simulation results and characterize the performance of the proposed memory device. 
Experimental results corresponding to the loop of Schmitt triggers are presented in Section |4j We 
close this work with the conclusions in Section [5] 



2 The system: a ring of two oscillators 

The system consists of a ring of bistable forward-coupled oscillators. The coupling is proportional 
to the amplitude of each oscillator, as it is described in [TU]. The system is described by the 
following set of stochastic differential equations 



for 1 < n < N, (1) 

where N is the number of oscillators, Wi represents standard Brownian motion, spatially uncor- 
rected {{Wi) = 0, and (dWidWj) = Sijdt), er 2 is the noise intensity, e is the coupling strength 
between adjacent oscillators, and U± (x) is the one-dimensional potential defined by 

We are interested in the shortest ring capable of storing information. We shall show that a loop of 
only two forward-coupled bistable oscillators not only presents an interesting dynamic behavior, 
but it can also work as a one-bit memory device. In the case of a ring comprising two oscillators, 
Eq. ([!]) can be written as 

dx = -V£/ 2 (x) dt + adW, (3) 

where dW — (dWi, dW 2 ) is the noise vector and the bi-dimensional potential, U-z (xx,X2), is 
expressed by 

U 2 {xi,x 2 ) = U, ( — ) 

It is simple to show that Eq. ([!]) cannot be written in the form of Eq. ^ for N > 2. It is useful 
to understand Eq. (J3J) as the equation of motion of a particle in the bidimensional potential in Eq. 
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Figure 1: Phase-space diagram for critical points of the system. Full lines correspond to stable 
equilibrium points, dashed lines correspond to saddle points and dotted lines correspond to unstable 
equilibria. The arrows indicate the direction of increasing of e . 

Depending on the coupling strength, the system, in the absence of noise, exhibits three different 
behaviors, and hence two bifurcations between them; the first at e — 2Uq/xq and the second at 
e = AUq/xq. When e < 2U~o/xq, the potential in Eq. Q presents one unstable equilibrium (i.e. a 
local maximum) at the origin xf 1 = = 0. It also exhibits four stable equilibrium points, one 
on each quadrant in the X1-X2 phase space (see Fig. [IJ. While the equilibrium points located in 
the upper-right and lower-left quadrants are global minima, the equilibria located in the other two 
quadrants correspond to local minima. As the coupling strength e increases, the wells corresponding 
to the global minima become deeper, and the wells of the local minima become shallower. 

For e = 2Uq/xq, the system undergoes a pitchfork bifurcation, where the local minima become 
saddle points, the equilibrium points located in the upper-right and lower-left quadrants remain 
global minima, and the origin remains a local maximum, as can be seen in Fig. [T| There is another 
pitchfork bifurcation at e = AUq/xq. In this case, the unstable equilibrium point x\^m — %2,m = 0, 
develops into a saddle point. In this situation, the system is notably similar to the one-particle 
bistable potential in Kramers-Smoluchowski [23 . 

In this work, we focus solely on the region < e < 2Uq/xq where the most interesting behavior 
is found. In Fig. [2j we show the bidimensional potential in Eq. Q for the particular case of 
e w 0.56U a /x . 
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Figure 2: The potential in EqJ4| for U = 256, x = V32 and e = 25 



2.1 Four-state model 

It is customary to approximate the behavior of a particle in a bistable potential by a two-state 
model (see, e.g., 8, 9 ). Similarly, we can approximately describe the behavior of the system in 
Eq. [3] as that of a system with four discrete states, one for each equilibrium point of the potential 
in Eq. [4] Let us enumerate the states as through 3, starting from the equilibrium point in the 
upper-right quadrant of Fig. [T] and moving in the counter-clockwise direction. If we denote by 
rii(t) the probability of finding the particle in the state i at time t, then the behavior of the system 
can be described by the following equation 

k = W-n, (5) 



where ft — (no, n%, ri2, n^) and W is the transition matrix. We can estimate these transition 
rates as (see, e.g., [23] [24]) W%j ~ exp {— 2ALV,/er 2 }, where Kij is a constant and AUij is the 
potential barrier that the particle has to overcome when moving from state i to state j. Symmetries 
present in the potential in Eq. [4] (sec Fig. |2| allow us to reduce the problem to the calculation of 
four transition rates dependent on the following potential barriers 



m 3 = \j - i\u i + (-iy 



2|j - i\U 



for ij = 01,10,13,02. 



(6) 



We shall come back to the four-state model in Section 13.1 
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3 Simulation results 



In order to store one bit, we drive the first oscillator with a short pulse of amplitude Pq and 
duration Tp. Since we are interested in a storage system that works solely in the presence of noise, 
we consider pulse intensities which are too low to force the system out of the deeper equilibrium 
states. In particular, for our simulations we set Pq such that the work exerted by the driving force 
is smaller than the potential barrier AUqi in Eq. 

Memory retrieval from oscillator i, at interrogation time to, is performed by taking the average 



ta+Tp 
to 



Xi{t ) = — / .(■;( /)-'//. I ) 



and comparing Xi(to) to a fixed threshold, arbitrarily set to 0. The system incurs in an error when 
Xi(t ) < 0. 

We assess memory performance by observing the time evolution of the probability of error upon 
retrieval of the stored bit, p e , estimated as the number of errors divided by the total number of 
realizations 

# number of errors in oscillator i , . 

Pl=^ , , r v- : , fori =1,2. (8) 

# total number ol realizations 



The results in this section correspond to a system with Uq — 256 and xq — v32. The pulse du- 



ration was set to Tp = 5 and pulse amplitude to Pa = 0.13AC/oi/:re«> where x eq — xq^I + €Xq/4Uq 
is the distance from the global minima to the coordinate axes. For each noise level, we performed 
10000 numerical simulations of Eq. ([3]), with initial conditions chosen randomly in the region 
[—9.0 : +9.0] x [—9.0 : +9.0], using the Euler-Maruyama method [25] with the integration step 
At = 6.1035 x 10" 4 . 

In Fig. [3] we show the evolution of the probability of error as a function of noise intensity 
and coupling strength. The dotted line indicates the instant at which the drive is turned off. 
Observe that the probability of error for the first oscillator is always smaller than that for the 



second. In the case of strong coupling (Fig. 3(a) I, the probability of error improves with time 



in both oscillators while the driving pulse is on. For small noise intensity, the degradation of the 
error probability is almost negligible after turning off the pulse, since noise is not strong enough 
to overcome the potential barrier. On the other hand, performance degrades at a faster pace for 
higher noise intensities. While the behavior of both oscillators is very similar for a strong coupling, 
for weaker coupling and a small noise intensity, the first oscillator outperforms the second (see 
Fig. |3(b)[ ). Indeed, the first oscillator rapidly follows the driving pulse, which is stronger than the 
weakly-coupled output of the second oscillator. However, the second oscillator is driven by the 
sub-threshold output of the first oscillator and, thus is not able to immediately follow the external 
drive. When the driving pulse is turned off p\ slowly increases because of noise and the influence 
of the second oscillator. On increasing the noise intensity, the performance of both oscillators 
becomes similar independently of the coupling strength. 

Figure [4] shows the estimated probability of error for each oscilllator as a function of noise 
intensity and for increasing times (T x = T P , T 2 = 10 T P , T 3 = 20 T P , and T 4 = 40 T P ). It is 
interesting to compare these results to the deterministic noiseless system. In this case it is simple 
to estimate error probabilities. Consider the phase space in Fig. [T] Since the driving pulse is only 
applied to the first oscillator, a particle in the upper-right and lower-right quadrants remains there 
after the pulse is turned off. Moreover, the pulse is strong enough to move a particle from the 
upper-left to the upper-right quadrant, but it is too weak to force the particle out of the lower-left 
quadrant (where there is a deep minimum of the potential, as shown in Fig. [2|. Therefore, the 
probability of error for the first oscillator is only 1/4. However, the probability of error for the 
second oscillator depends on the coupling strength. If the coupling is strong, then the output of 
the first oscillator is capable of driving the second and p\ = 1 /4. On the other hand, if the coupling 
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strength is weak, the state of the second oscillator does not change as a consequence of changes in 
the output of the first and, hence, p\ = 1/2. A small amount of noise is enough to improve memory 
performance as it allows a particle located in the lower-right quadrant to escape to adjacent wells. 
Fig. [4] shows the positive influence of noise. An antiresonant behavior is readily observed, i.e., the 
probability of error is optimized for a given noise intensity, a signature of stochastic resonance. 

Now we turn to the dynamic behavior of the coupled oscillators. Results shown in Fig. |4]indicate 
that the coupling strength plays a significant role in the dynamics of the memory device: for weak 
coupling strengths, the minimum p e increases with time (i.c, memory performance degrades), 
whereas it remains approximately constant for a strong coupling strength. This is a desirable 
feature for implementation of a practical device, as it points to a system whose performance, not 
only benefits from added noise, but it is also robust in a noisy environment. As expected, in both 
cases the noise range that yields the minimum p e decreases with time. 



3.1 Synchronization and memory persistence 

Keeping in mind a practical realization of the coupled double- well system as a 1-bit storage device, 
not only we require information retrieval to be 'asynchronous' in the sense that it is possible to 
interrogate the system at any time, but also that we obtain a unique value for the memory state 
when we interrogate any of the two oscillators. We say that the oscillators are 'synchronized' if 
pi and p\ differ in a small quantity, arbitrarily fixed to 10 -3 . Results in Fig. 3(b) show the time 
evolution of the probability of error for three different noise intensities, starting at the time when 
the external pulse is switched on, until the two oscillators are synchronized. We define the elapsed 
time between these two events as the synchronization time T s . By comparing the performance of 
the two oscillators, we find that, until synchronization is reached, the second oscillator exhibits a 
worse error rate for all noise levels. This is due to the fact that the external pulse acts exclusively 
on the first oscillator. 

Fig. [5]shows the synchronization features (i.e. synchronization time and probability of error at 
synchronization) as a function of the noise intensity. Interestingly, increasing the noise intensity 
makes T s decrease. 

The behavior of the synchronization time when it is greater than Tp can be qualitatively 
described as follows: suppose that memory retrieval is carried out by instantaneously observing 
the state of the oscillator, i.e., without computing the average in Eq. ([7]). Then, the probability 
of error can be written in terms of the state probabilities in Eq. ^ as p\{t) — nx{t) + ni{t) and 
Pe(i) — ri2(t) + n^,{t). Solving Eq. ^ for a given initial condition, it can be shown that 

pl(t)-p 2 e (t)oce- 2 ^+ w ^ t . 

Therefore, the synchronization time must be 

T = T (9) 

s 2(W 10 + W^) ' 1 ' 

where r is a suitably chosen constant. Although we have derived Eq. (JsJ) assuming instantaneous 
observations of the oscillators, it is reasonable to expect that the equation is still approximately 
valid when the average in Eq. ^ is computed for T s > Tp. Indeed, we can observe that Eq. [9] fits 
well the numerical results in Fig. [5j where W\q and W\§ were computed using Eq. (|6| and r was 
calculated by fitting only the simulated value corresponding to the smallest noise intensity. 

As it can be observed in Fig. [5j there is a range of noise intensities, enclosed by the dotted 
lines, for which both p e is small and T s is close to its minimum, i.e, the device performs well and 
any of the two oscillators can be interrogated, at any time, in order to retrieve the memory state. 

Finally, we propose the following criterion as a way to characterize the persistence time of the 
memory, (T m ): we take (T m ) as the time elapsed until the first oscillator reaches a probability of 
error rate equal to that corresponding to the noiseless case, i.e, from that point on, noise no longer 
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helps improve device performance. This definition allows us to specify a 'refresh' time scale, in a 
similar fashion as in common DRAM devices (see, e.g., [25]). Note that, from Fig. [6] where T m is 
shown as a function of noise intensity and for a weak coupling strength, T m presents a stochastic 
resonance characteristic. The explanation of this behavior lies in the fact that, for an optimal noise 
level, the system moves easily to the upper-right equilibrium state, but hardly ever leaves it. Note 
that for this optimal noise level, the memory device not only maximizes the persistence time, but 
also both oscillators are synchronized and the probability of error is minimal. 

4 Experimental results 

In this section we present experimental results corresponding to a ring of two Schmitt triggers. 
We use STs as 'discrete' models of the bistable potentials in previous sections. A single pulse, 
representing the '1' state that is to be stored, is fed into the first ST with a supra-threshold 
amplitude of +5 V and duration Tp = 1 ms. The ST thresholds are set to +3 V and -1 V, 
respectively. The output of the first ST, set to sub-threshold values of +2 V and V respectively, 
is used to drive the second ST. Then, the output of the second ST is fed back into the first ST and 
we allow for a delay of t — 98Tp before refreshing the memory by again applying the driving pulse. 
In the experimental setup, noise is generated by low-pass filtering of a pseudo-random bit sequence 
(PRBS) generator working at a rate of 250 kHz [27]. Since the filter cutoff 3-dB bandwidth is 
chosen greater than 10 KHz, the noise spectral density is flat over the studied range. 

During the time when the system is not driven, we interrogate the second ST at intervals of 
Tp. As discussed in previous sections, the detector averages the received amplitude over a fraction 
of Tp and compares it to a fixed threshold, in order to make a decision between a '1' and a '0' 
states. Finally, we repeat this procedure 1000 times, alternating the initial state of the second ST, 
and compute the probability of error by counting the number of times a '0' state was detected. 

Fig. [7] shows the estimated probability of error as a function of noise intensity and elapsed 
time. As it can be observed, p e behaves in a similar manner as in Fig. |4jd). For instance, p e = 1/2 
for low noise intensities because the sub-threshold output of the first ST is not strong enough to 
drive the second ST. It can also be observed that there is a range of noise that minimizes the 
probability of error, a signature of stochastic resonance which is also present in the results in Fig. 
[4] In this range we computed no errors, i.e., estimated p e < 10~ 3 . Also, around the optimum 
noise intensity, device performance does not degrade with time. In summary, experimental results 
obtained with discrete bistable potentials built around Schmitt triggers reproduce well the main 
characteritics of the proposed stochastic-resonance 1-bit memory device, paving the way for a 
practical implementation. 

5 Conclusions 

In this work, we studied the dynamical behavior of a system comprised of two bistable oscillators 
in a loop configuration. In particular, we showed that such a system is capable of storing a single 
bit of information in a noisy environment. Furthermore, by calculating the probability of error 
upon retrieval of the stored bit, we showed that performance in the presence of noise exceeds that 
of the deterministic noiseless system, a signature of stochastic resonance. 

The proposed device can be regarded as 'asynchronous', in the sense that stored information 
can be retrieved at any time. Moreover, after a certain 'synchronization' time, the probability 
of erroneous retrieval does not depend on the interrogated oscillator. Interestingly, we found 
that there is a range of noise intensities which both minimizes the probability of error and the 
synchronization time. 

System performance can also be characterized by the memory persistence time, which we defined 
as the time elapsed until the probability of error equals that of the noiseless case. We found that 
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this persistence time is maximized for the same noise range that minimizes the probability of error 
and ensures synchronization. 

Then, we built a model of the proposed device by means of a loop of two Schmitt triggers, 
acting as 'discrete' analogues of the bistable oscillators. We were able to show experimentally that 
this system is capable of storing a single bit and does so more efficiently in the presence of noise. 

In summary, we believe that the proposed device may serve as a building block of future 
computing systems which, due to the increasing scale of integration, will have to deal with smaller 
noise margins. 
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(a) p e vs. time for e = 75 




(b) p e vs. time for e = 25 



Figure 3: The evolution of the probability of error as a function of noise intensity and coupling 
strength. In both figures, "p\ is always smaller than "p\. 
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(a) pi vs. noise for e = 75 
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Figure 4: Probability of error as function of noise intensity for different observation times (T = Tp, 
10Tp, 20T P , AOTp) and coupling strengths (e = 25 and 75). 
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Figure 5: Synchronization time (T s ) and probability of error at T s as a function of noise intensity. 
Solid line corresponds to a theoretical approximation to T s . 
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Figure 6: Persistence time as a function of noise intensity. 
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Figure 7: Experimental results for a loop of two STs: Memory performance as a function of the 
noise intensity and time. 
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